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Abstract We consider an irreducible pure jump Markov process with rates Q = 
(q(x, y)) on A U {0} with A countable and an absorbing state. A quasi-stationary distri- 
bution (qsd) is a probability measure v on A that satisfies: starting with v, the conditional 
distribution at time t, given that at time t the process has not been absorbed, is still v. 
That is, v[x) = vP t (x)/(Y2 yeA uP t (y)), with P t the transition probabilities for the process 
with rates Q. 

A Fleming- Viot (fv) process is a system of N particles moving in A. Each particle 
moves independently with rates Q until it hits the absorbing state 0; but then instan- 
taneously chooses one of the N — 1 particles remaining in A and jumps to its position. 
Between absorptions each particle moves with rates Q independently. 

Under the condition a := J2 X m ^ Qi'i x ) > supC}(-,0) := C we prove existence of QSD 
for Q; uniqueness has been proven by Jacka and Roberts. When a > the FV process 
is ergodic for each N. Under a > C the mean normalized densities of the FV unique 
stationary measure converge to the QSD of Q, as N — »■ oo; in this limit the variances 
vanish. 
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1 Introduction 

Let A be a countable set and Z t be a pure jump regular Markov process on A U {0} with 
transition rates matrix Q = (q(x,y)), transition probabilities P t (x,y) and with absorbing 
state 0; that is q(0, x) = for all x G A. Assume that the exit rates are uniformly bounded 
above: q := sup x ^ yG {o}uA\{a;} l( x ^ V) < 00 > ^ na ^ Pt{ x ,y) > for all x,y G A and t > 
and that the absorption time is almost surely finite for any initial state. The process Z t is 
ergodic with a unique invariant measure 5q, the measure concentrating mass in the state 0. 
Let /i be a probability on A. The law of the process at time t starting with \i conditioned 
to non absorption until time t is given by 

1 - 22yeAv{y)Pt{y,o) 
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A quasi stationary distribution (qsd) is a probability measure u on A satisfying = v. 
Since P t is honest and satisfies the forward Kolmogorov equations we can use an equivalent 
definition of QSD, according Nair and Pollett ^2j. Namely, a QSD ( and only a qsd) is a left 
eigenvector v for the restriction of the matrix Q to A with eigenvalue — £ ygA v(y)q(y, 0): 
v must satisfy the system 

Y,v{y)[q{y,x) + q{y,o>{x)\ = o, Vxga. (1.2) 

yeA 

(recall q(x, x) = - £ v eAu{o}\{z} q(x, v)-) 

The Yaglom limit for the measure \x is defined by 



lim <rf(y) , yeA (1.3) 



if the limit exists and it is a probability on A. 

When A is finite, Darroch and Seneta (1967) prove that there exists a unique QSD v 
for Q and that the Yaglom limit converges to v independently of the initial distribution. 
When A is infinite the situation is more complex. Neither existence nor uniqueness of QSD 
are guaranteed. An example is the asymmetric random walk p = q(i, i + = 1 — q{i, i — 
for % > 0. In this case there are infinitely many QSD when p < 1/2 and none when p > 1/2 
(see Cavender [2] and Ferrari, Martinez and Picco jE] for birth and death more general 
examples). For A = N under the condition lim :r ^ 00 P(i? > t\Zo = x) = 0, where R is the 
absorption time of Z t , Ferrari, Kesten, Martinez and Picco |Hj prove that the existence of 
QSD is equivalent to the existence of a positive exponential moment for R, i.e. Ke eR < oo 
for some 6 > 0. When the Yaglom limit exists, it is known it is a QSD, but existence of the 
limit is not known in general for infinite state space. Phil Pollett maintains an updated bib- 



liography on QSD in the site http://www.maths.uq.edu.au/ pkp/papers/qsds/qsds.html 



Define the ergodicity coefficient of the chain Q by 

a = a(Q) := V inf q(x, z) (1.4) 

^x£A\{z} 

If a(z) := m{ x ^ z q(x, z) > 0, then z is called Doeblin state. Define the maximal absorbing 
rate of Q by 

C = C(Q) := sup q(x,0) (1.5) 

Since the chain is absorbed with probability one, C > 0. On the other hand, C < q, the 
maximal rate. 

Jacka and Roberts j^j proved that if there exists a Doeblin state z £ A such that 
a (z) > C and if there exists a QSD v for Q, then v is the unique QSD for Q and the 
Yaglom limit converges to v for any initial measure fi; their proof also works under the 
weaker assumption a > C. We show that a > C is a sufficient condition for the existence 
of a QSD for Q. 
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Theorem 1.1. If a > C then there exists a unique QSD v for Q and the Yaglom limit 
converges to v for any initial measure fi. 



The condition a > C is disjoint to the condition lim x P(_R > t\Z = x) = 0, under 
which j2] show existence of QSD. On the other hand, a > implies that R has a positive 
exponential moment. 

The Fleming- Viot process (fv). Let N be a positive integer and consider a system of 
iV particles evolving on A. The particles move independently, each of them governed by 
the transition rates Q until absorption. At most one particle is absorbed at any given 
time. When a particle is absorbed, it returns instantaneously to a state in A chosen with 
the empirical distribution of the particles remaining in A. In other words, it chooses one 
of the other particles uniformly and jumps to its position. Between absorption times the 
particles move independently governed by Q. This process has been introduced by Fleming 
and Viot [Zj and studied by Burdzy, Holyst and March pQ, Grigorescu and Kang |Hj and 
Lobus ^T] in a Brownian motion setting. The generator acts on functions / : A^ 1 '"'' N ' — > K 
as follows 

= E E [^(«%y)+?(ew,o)5^](/(^-/(e)) (i.e) 

i=l j/GA\{5(i)} 

where C' y U) = V f° r 3 = * an d C' y {j) = otherwise and 

^,y):=^l{^) = y}. (1.7) 

i=l 

We call the process in A*- 1 ''"'^ with generator (jl.fi)) and = r/(£t, •) the corresponding 
unlabeled process on N A ; ?7t(x) counts the number of £ particles in state x at time t. For 
/x a measure on A, we denote £ t ,At the process starting with independent identically /i- 
distributed random variables (£0^(2), i = 1, . . . ,iV); the corresponding variables tjq'^^x) 
have multinomial law with parameters and (//(#), iGA). The profile of the FV process 
at time t converges as A^ — > 00 to the conditioned evolution of the chain Z t : 

Theorem 1.2. Let /i be a probability measure on A. Assume that (£0^(2), i — 1,... ,N) 
are iid with law \i. Then, for t > and x £ A, 

/n N ^(x) \2 

» b i E ( ! hf i -^) =° ( L8 > 

The convergence in probability has been proven for Brownian motions in a compact 
domain in PQ. Extensions of this result and the process induced in the boundary have been 
studied in jH] and jTTj. 

When A is finite, the FV process is an irreducible pure-jump Markov process on a finite 
state space. Hence it is ergodic (that is, there exists a unique stationary measure for the 
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process and starting from any measure, the process converges to the stationary measure). 
When A is infinite, general conditions for ergodicity are not still established. We prove the 
following result 

Theorem 1.3. If a > 0, then for each N the FV process with N particles is ergodic. 

Assume a > 0. Let r/ N be a random configuration distributed with the unique invariant 
measure for the FV process with N particles. Our next result says that the empiric profile 
of the invariant measure for the FV process converges in L2 to the unique QSD for Q. 

Theorem 1.4. Assume a > C. Then there exists a probability measure v on A such that 
for all x G A, 

lim e(^^ - iy(x)) 2 = (1.9) 
Furthermore v is the unique QSD for Q. 

Sketch of proofs The existence part of Theorem II. II is a corollary of Theorem II .41 The 
rest is a consequence of Jacka and Robert's theorem (stated later as Theorem I5.1JI . 

Theorem 11.31 is proven by constructing a stationary version of the process "from the 
past" as in perfect simulation. We do it in Section El 

Theorems 11.21 and 1 1 . 41 are both based on the asymptotic independence of the £ particles, 
as N — > 00. Lemma 15.11 later shows that tp t is the unique solution of the Kolmogorov 
forward equations 

j t tf(x) = + q(y,0)tf(x)}, x e A (1.10) 

yeA 

From a generator computation, taking /(£) = r/(^,x) in (jl.6|) . 

yeA 

If solutions of (jl.llj) converge along subsequences as iV -> 00, then the limits equal the 
unique solution of (jl.lOj) . In fact, we prove in Proposition 13. II that for x,y G A, 

E(^(y) r£"{x) - E V ^(y) E v ^(x)) = 0(N) (1.12) 

This argument shows the convergence of the means Er}p*{x)/N to <tf{x). Since the vari- 
ances ( p,12j) . with x = y) divided by A^ 2 go to zero, the L2 convergence follows. 



4 



The stationary case is proven analogously. If rj is distributed with the invariant 
measure for the FV process, from 1)1. lip . 



Under the hypothesis a>Cwe show a result for r] N analogous to ()1.12j) to conclude that 
solutions of ()1.13j) converge to the unique solution of ()1.2jl . 

To show that the limits are probability measures it is necessary to show that the families 
of measures (■h'&r] t ' M , iVeN) and (jMt) n , IVgN) are tight; we do it in Section HJ 

Comments One interesting point of the Fleming- Viot approach is that it permits to 
show the existence of a QSD in the a > C case, a new result as far as we know. 

Compared with the results for Brownian motion in a bounded region with absorbing 
boundary (Burdzy, Holyst and March PQ, Grigorescu and Kang |8J and Lobus ^T] and 
other related works), we do not have trouble with the existence of the FV process, it is 
immediate here. On the other hand those works prove the convergence in probability 
without computing the correlations. We prove that the fact that the correlations vanish 
asymptotically is sufficient to show convergence in probability. For the moment we are able 
to show that the correlations vanish for the stationary state under the hypothesis a > C. 

The conditioned distribution (p% is not necessarily the same as -^Krjf'^, the expected 
proportion of particles in the FV process with iV particles. This has been proven in Ex- 
ample 2.1 of [I for A = {1,2} and g(l,0) = q(l,2) = q(2,l) = 1. The QSD v for this 
chain (the unique solution of (JO!)) is v(l) = (3 - y/E)/2 and u{2) = (-1 + y/E)/2. The 
unlabeled process rjf with two particles assumes values in {(1, 1), (2,0), (0,2)} with rates 
a((0, 2), (1, 1)) = a((l, 1), (0, 2)) = a((2, 0), (1, 1)) = 2 and a((l, 1), (2, 0)) = 1. The invari- 
ant measure for r/ 2 gives weight 2/5 to (1, 1) and (0, 2) and weight 1/5 to (2, 0). This implies 
that in equilibrium the mean proportion of particles in states 1 and 2 are p 2 (l) = 2/5 and 
p 2 {2) = 3/5 respectively. Our values for v and p 2 do not agree with those of |T], but the 
conclusion is the same: v ^ p 2 , which in turns implies \^rj 2,v ^ = v for sufficiently large 
t, as \^rjl' u converges to p 2 as t grows. More generally, for rational rates q, the equilibrium 
mean proportions p N have rational components, as they come from the solution of a linear 
system with rational coefficients, while those of v may be irrational, as v is the solution of 
a nonlinear system. 

To prove tightness we have classified the £ particles in types. This already appears 
in Burdzy, Holyst and March pQ to show the convergence result. Our application here is 
somehow simpler. Curiously our tightness proof needs the same condition [a > C) as the 
vanishing correlations proof. 




(1.13) 
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2 Construction of FV process 



In this section we perform the graphic construction of the FV process £ t . Recall C < oo 
and a > 0. Recall a(z) = va£ x eA\{z} q(x, z). 

For each i = 1, . . . , N, we define independent stationary marked Poisson processes 
(PP's) on E: 

• Regeneration times. PP rate a: (a^) ne z, with marks (A l n ) ne z 

• Internal times. PP rate q — a: (&JJ n eZ, with marks ((B^x), x G A), n G Z) 

• Voter times. PP rate C: (cjj ne z, with marks {{C l n , (F^(x), x G A)), n E Z) 



The marks are independent of the PP's and mutually independent. The denominations 
will be transparent later. The marginal laws of the marks are: 

= y) = <x(y)/a, y G A; 



. p(s* (*) = y ) = gfo^^M , x e A> y e A \ 

P(5* (x) = x) = 1 - E^mw = y). 

• P(i^(*) = 1) = = 1 - P(i^(x) = 0), x G A. 

Denote (Jl, J 7 , P) the space where the product of the marked Poisson processes has been 
constructed. Discard the null event corresponding to two simultaneous events at any given 
time. 

We construct the process in an arbitrary time interval [s,t]. Given the mark config- 
uration uj G Vt we construct £^fj(= £\^t]u>) m ^ ne time interval [s, t] as a function of the 
Poisson times and its respective marks and the initial configuration £ at time s. 

The relation of this notation with the one in Theorem 11.21 is the following: 

e t ^=$f (2.i4) 

where X = (X±, . . . , Xn) is a random vector with iid coordinates, each distributed accord- 
ing to [L on A. That is, for any function / : A^ — > M, 
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Construction of = ^ 

Since for each particle % there are three Poisson processes with rates C, a and q — a, 
the number of events in the interval [s,t] is Poisson with mean N(C + q). So the events 
can be ordered from the earliest to the latest. 

At time s the initial configuration is £. Then, proceed event by event following the 
order as follows: 

The configuration does not change between Poisson events. 

At each regeneration time a l n particle i jumps to state A l n regardless the current con- 
figuration. 

If at the internal time b l n — the state of particle % is x, then at time b l n particle % jumps 
to state B % n [x) regardless the position of the other particles. 

If at the voter time c l n — the state of particle % is x and F^(x) = 1, then at time c l n 
particle i jumps to the state of particle C l n ; if F % n [x) = 0, then particle i does not jump. 

The configuration obtained after using all events is The denominations are now 
clear. At regeneration times a particle jumps to a new state independently of the current 
configuration. At voter times a particle either jumps to the state of another particle chosen 
at random or does not jump. At internal times the particle jumps are indifferent to the 
position of the other particles. 

Lemma 2.1. For each s6l, the process (£r s '|, t > s) is Markov with generator M.b}) and 
initial condition £< s '% = £. 

Proof Follows from the Markov properties of the Poisson processes; the rate for particle 
i to jump from x to y is the sum of three terms: (a) a^^- (the rate of a regeneration event 
times the probability that the corresponding mark takes the value y) , (b) (q — a) ifellzHW 
(the maximal rate of internal events times the probability that the corresponding mark 

takes the value y) and (c) C 9 ^* -*-{£(■?' ) = y}jTl (^ ne max i ma l absorption rate 
times the probability the absorption rate from state x divided by the maximal absorption 
rate times the empirical probability of state y for the particles different from i). The sum 
of these three rates is the rate indicated by the generator (the square brackets in with 
=x). □ 

Generalized duality For each realization of the marked Poisson processes in the interval 
[s,t] we construct a set \P£,[s,tJ C {1,...,N} corresponding to the particles involved at 
time s with the definition of £r s 'ij We drop the label uj in the notation. 

Initially ^f l [t, t] = {i} and look backwards in time for the more recent z-Poisson event 
at some time r in the past of t but more recent than s. If r is a regeneration event, then 
we don't need to go further in the past to know the state of the i particle, so we erase the 
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% particle from ^> 1 [t— , t\. If r is the voter event d n , its C l n mark pointing to particle j, say, 
then we need to know the state of the particle i at time r— to see which F % n will be used 
to decide if the i particle effectively takes the value of particle j or not. Hence, we need to 
follow backwards particles i and j and we add the j particle to W[r—,t\. Then continue 
this procedure starting from each of the particles in \l/ l [r— ,t]. The process backwards 
finishes if ^ l [r, t] is empty for some r smaller than s or if we have processed all marks 
involving i in the time interval [s,t\. More rigorously: 

Construction of ^[s,t] 

We construct ^[s, £] backwards in time. Changes occur at Poisson events and \l/ l [s,t] 
is constant between two Poisson events. The construction of depends only on the 

regeneration and voter events. It ignores the internal events. 

Initially tf*[M] = {*}• 

Assume ^ l [r', t] has been constructed for all r' G [r',t\. Let r be the time of the latest 
Poisson event before r' . 

Set W\r\t\ = tfV,*] for all r" e (r,r']. 

If r < s stop, we have constructed \F[r, t] for all r e [s,t]. If not, proceed as follows. 
If r is a regeneration event involving particle j (that is, t = a 3 n for some n), then set 



and Cl = j), then set ^[r,t] = ^[r',t] U {j}. 
This ends the iterative step of the construction. 

For a generic Poisson marked event m let time(m) be the time it occurs and label(m) 
its label; for instance time(c^) = d n , label(c^) = i. Define 



There is no explicit formula for H but the important point is that for any real time s, £r s '5(i) 
depends only on a finite number of Poisson events contained in u/[s, i] and on the initial 
state of the particles j £ ^[s, t\. The internal marks involved with the definition of £ 
depend on the initial configuration £ and the evolution of the process but in any case are 
bounded by a Poisson random variable with mean g|^ l [s, t]\. 





(2.16) 



(2.17) 



(2.18) 
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Proof of Theorem 11.31 If the number of marks in uu l [— oo,t] is finite with probability 
one, then the process 

£&(i)= lim H^tlCM), ie{l,...,N}, teR (2.19) 

is well defined with probability one and does not depend on £. By construction teR) 
is a stationary Markov process with generator (jl.hj) . Since the law at time t does not depend 
on the initial configuration £, the process admits a unique invariant measure, the law of 
£f. See Q] for more details about this argument. 

The number of points in uj 1 [— oo, £] is finite if and only if for some finite s < t, [s, t] = 0. 
But since there are 3N stationary finite-intensity Poisson processes, with probability one, 
for almost all u there is an interval [s(co), s(uj) + 1] in the past of t such that there is at 
least one regeneration mark for all particle k and there are no voter marks in that interval. 
We have used here that the regeneration rate a > 0. This guarantees that ty l [s(uj), t] = 0. 
To conclude notice that if **[s,t] = 0, then W i [s , ,t] = for s' < s. □ 



3 Particle correlations in the FV process 



In this section we show that the particle-particle correlations in the FV process with iV 
particles is of the order of 1/N. 



Proposition 3.1. Let x, y 6 A. For all t > 



Ff Vt r ' li (x)vt r ' ,i {y) \ E / ^f' M (^) \ / m'^jy) 

N 2 J \ N ) \ N 



2Ct 



(3.20) 



Assume a > C . Let i] N be distributed according to the unique invariant measure for the 
FV process with N particles. Then 



7 , v N (x)v N (y) \ 

" ! N 2 ) 



Ei !fM) E n N (y) 



N 



N 



1 

< — 



a 



N a - C 



(3.21) 



We introduce a 4-fold coupling (^[s, t], W[s, t], **[s, t], &[s, t]) with **[s,t] = &[s,t] 
with the property ll ^ j [s,t] n ^[s,*] = implies = and such that the 

marginal process (^[s, t], ^[s, t]) have the same law as two independent processes with the 
same marginals as (^[s, t], ^[s, £]). The construction is analogous to the one in Fernandez, 
Ferrari and Garcia 0j. 

We use two independent families of marked Poisson processes each with the same law 
as the Poisson family used in the graphic construction; the marked events are called 
red and green. We augment the probability space and continue using P and E for the 
probability and the expectation with respect to the product space generated by the red 
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and green events. With these marked events we construct simultaneously the processes 
(& % [s, t], ^f j [s, t], if? l [s, t], W[s, t\) and a new process I[s,t] as follows. 

Initially set l[t,t] = 0, &[t,t] = #*[*,*] = i and &[t,t] = ^ j [t,t] = j 

Go backwards in time as in the construction of in Section|21proceeding event by event 
as follows. Assume I[r', t], \l/ l [r',t], \E fi [r', t] , ^[r', t] and \& J '[r', t] have been constructed for 
all r' e [t', t]. Let r be the time of the latest Poisson event before r' . 

If I[t', t] = 1 then: (a) if the event is green, use it to update ^'[r, t], ^'[r, t] and ^ j [r, t] 
only; (b) if the event is red, use it only to update W[t, t]. 

Ul[r',t] = then: 

(a) if the event is green, then use it to update \l/ l [r, t], ^ l [r, t] and ^[r, t}. Use it also to 
update ^[r, t] only if (after the updating) ^ [r, t] fl \& l [r, t] = 0. Otherwise do not update 
¥[r,t] and set I[r,£] = 1. 

(b) if the event is red do not use it to update &[t, t], ^ l [r, t] and \P 3 '[t, t]. Use it to 
update ^[t, t] only if after the updating W[t, t] fl ^'[r, t] 7^ 0; in this case set l[r,t] = 1. 
Otherwise do not update \I/ 1 [t, t] and keep I[r, £] = 0. 

The processes so constructed satisfy 

1. l[s,t] indicates if the hated processes intersect: 

I[s,t] = l{&[s,t] n ¥[a,t] ^ 0}. (3.22) 

2. \I/*[s,£] and ^[s, £] are constructed using only the green events. 

3. ^*[s, i] is also constructed using the green events, hence it coincides with \l/ l [s, £]. 

4. ^[s, t] is constructed with a combination of the red and green events in such a way 
that it coincides with ^ J '[s,t] as long as possible, it is independent of ^*[s,<] and has 
the same marginal distribution of ^'[s, £]. 

We use the coupling processes to estimate the covariances of Call u^[s,t], u l [s,t], 

& 3 '[s, t] and u l [s, t) the set of marked events defined with (j2.16|) using ^[s, t), ^f z [s, t), ^[s, t] 
and respectively. Take two independent random vectors X and Y with the same 

distribution as in (|2.14J) . that is, iid coordinates with law //. Denote the initial particles 
defined as in (|2~T7j) by X j [s,t], X l [s,t], X j [s,t] and Y*[s,t] as function of &[s,t}, 
\I/ J [s,t] and ^*[s, £] respectively. Denote uj 1 instead of a/[s,£], X % instead of X l [s,t], etc.; 
we have 

p®) = = v)- n&) = *)p(®(0 = y) 

= = *, « = y) - n$$v) = *m^d) = v) (^) 

= e(i{H(<J,X*) = x, H(lu\X 1 ) = y)} - l{H(u j ,X j ) = x), H(u\Y l ) = y)}) 
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If l[s,t] = then &[s',t] = ^ j [s',t] and ¥[s',t] = ¥[s',t] for all s' G [s,t] and the same 
holds for the corresponding ct/s. Also, given l[s,t] = 0, X J and Y % depend on disjoint sets 
of initial particles. This implies that we can couple X 1 and Y % in such a way that in the 
event l[s,t] = 0, X % = Y\ Hence, taking absolute values in ()3.23j) we get 

rn^ti) = x,$$(i) =y)- n$;tu) = *)p(®w = y)\ < m*A = i)- (3-24) 

Lemma 3.1. For t > and different particles i,j G {1, . . . , N} 

P(I[M] = 1) < (1 - ^-)(*-.)) (3.25) 

Proof: At time s the process I[s, t] jumps from to 1 at a rate depending on &[s, t] and 
^'[s, i] which is bounded above by 

2C 

F - I **[ a ,t]^[ a ,t]l{I[5,t] = 0} 

Dominating the indicator function by one: 

P(I[M] = 0|.F M ) > exp^-j^-^j ¥[s\t]P[s\t]ds'j (3.26) 

where F^t] is the sigma field generated by ((W^s', t], ^'[s', i]), s < s' < £). From ()3.26|) . 
using 1 — e _a < a and taking expectations, 

P(I[s,t] = l) < — — - / E#V,t]E^' [s',t]ds' (3.27) 

On the other hand, ^'[s', i] is dominated by the position at time t — s of a random walk 
that grows by one with rate C and decreases by one with rate a. Hence its expectation is 
bounded above by e^ s ^ c ~ a \ Substituting this bound in ([3.27)1 . 

P (I[ S) t ] = 1) < J* e^-^-^ds' (3.28) 

which gives (|3.25J) . □ 

Proof of Proposition 13.11 Defining 



N 



i=i 



ii 



Then has the same law as r^lg and r] N has the same law as i]^^ t , . Hence 



E 



N 2 > N 2 ._. 

i=i 3=1 

Using this, (gUj) and (l3~2~Kj) with s = and a = we get (fHH). 

If a > C, r],^ converges as s — > — 00 to r]^ a configuration distributed with the unique 
invariant measure, as in Theorem 11.31 see (|2.19jl for the corresponding statement for ^ . 
Hence the left hand side of ()3.21j) is bounded above by P(I[— 00, t] = 1). Taking s = —00 
in dQ3]) we get (l3~2TJ) . □ 



4 Tightness 

In this section we prove tightness for the mean densities as probability measures in A, 
indexed by N. 

Proposition 4.1. For all t > 0, x G A, i = 1, . . . , N and probability fi on A it holds 

< C <*X>(*)P t (*,*). (4-1) 

zeA 

As a consequence the family of measures (E^ '^/N, iVeN) is tight. 

Assume a > and define the probability measure \i a on A by 

/i a (x) = — , x G A, 
a 

where a x = inf 2 g(z, x). For z, x G A define 

/•oo 

R x (z,x)= Xe- xt P t (z,x)dt. (4.2) 







The matrix i?A represents the semigroup P% evaluated at a random time T\ exponentially 
distributed with rate A independent of (Z t ). R\(z,x) is the probability the process (Zl) 
be in x at time T\. The matrix R is substochastic: J2 x eA ^{ z i x ) ls J us t the probability 
of non absorption of {Zf) at the random time T\. 

Proposition 4.2. Assume a > C and let p N (x) be the mean proportion of particles in 
state x under the unique invariant measure for the FV process with N particles. Then for 

x e A, 

p N (x) < —- ^ a R {oi _ c) {x) (4.3) 

OL — O 

As a consequence, the family of measures (p N , N G N) is tight. 
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Types To prove the propositions we introduce the concept of types. We say that particle 
% is type at time t if it has not been absorbed in the time interval [0,t\. Particles may 
change type only at absorption times. If at absorption time s particle i jumps over particle 
j which has type k, then at time s particle i changes its type to k + 1. Hence, at time t a 
particle has type k if at its last absorbing time it jumped over a particle of type k — 1. We 
write 

type(i,t):= type of particle i at time t. 
The marginal law of ^ ,fl (i)l{type(i,t) = 0} is the law of the process Z^: 

P(£f'"(i) = x,type(i,t) = 0) = J2»{z)P t (z,x). (4.4) 

zGA 



Proof of Proposition H~T1 Since Er,t N — = P(^ 7V,M (i) = x), it suffices to show that for 
k > 

P(^(i) = x, type(i, t) = k) < ^ x) ( 4 - 5 ) 

zeA 

We proceed by induction. By ()4.4|) the statement is true for k = 0. Assume ()4.5|) holds 
for some k > 0. We prove it holds for + 1. Time is partitioned according to the last 
absorption time s of the ith particle. The absorption occurs at rate bounded above by C. 
The particle jumps at time s to a particle j with probability 1/(N — 1), this particle has 
type k and state y. Then it must go from y to x in the time interval [s, t] without being 
absorbed. Using the Markov property, we get: 

P(^(z)=x,type(M) = fc + l) (4.6) 

- f C A73T E E = V, type(j, 3) = fc) P,_ s (y, x) ds. (4.7) 

^ i^i yeA 

The symmetry of the particles allows to cancel the sum over j with (N— l) -1 . The recursive 
hypothesis ()4.5|) implies that ()4.7|) equals 



^° ' zeA j/eA 

' j - J>(z)P t (z,:r). 



v ' zeA 

by Chapman-Kolmogorov. This completes the induction step. □ 
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Proof of Proposition W72\ If £ N is distributed according to the unique invariant measure 
for the FV process then p N = F(^ N (i) = x). Since a > we can construct a version of the 
stationary process £g such that P(^ Ar (z) = x) = P(^(«) = x), Vs. We analyze the marginal 
law of the particle distribution for each type, as in the proof of Proposition 14. 11 Define the 
types as before, but when a particle meets a regeneration mark, then the particle type is 
reset to 0. In the construction, at that time the state of the particle is chosen with law fi a . 

Under the hypothesis a > C the process 

W, type(M)), * = l,---, AO, teK) 

is Markovian and can be constructed in a stationary way as $ . Hence 

A k (x) := P(^(i) = x, type(i, s) = k) (4.9) 

does not depend on s. 

The regeneration marks follow a Poisson process of rate a and the last regeneration 
mark of particle i before time s happened at time s — T % al where T l a is exponential of rate 
a. Then, 

POO 

A (x) = / ae~ at ^2/j, a (z)P t (z,x)dt = fi a R a (x). (4.10) 
A reasoning similar to (|4.6|) - (|4.7jl implies 

P CO 

A k {x) < / e- at CJ2 A k-i(z)Ps(z,x)dt. (4.11) 
= -A k ^R a (x) < (-) k fi a R k a +1 (x). (4.12) 



We interpret R^(z,x) as the expectation of P Tk (z,x), where r k is a sum of k independent 
random variables with exponential distribution of rate A. Summing ([4.11)1 . and multiplying 
and dividing by (a — C), 



F(Cf« =x)< (-)Vl - -)» a Rl + \x) (4-13) 

fc=0 



The sum can be interpreted as the expectation of fi a R^ , where K is a geometric random 
variable with parameter p = 1 — (C/a). Since an independent geometric(p) number of 
independent exponentials(a) is exponential (ap), we get 

P(£f(z) = x) < -^-fi a R a - C (x). □ (4.14) 
a — G 
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5 Proofs of theorems 



In this section we prove Theorems 11.31 and 11.41 We start deriving the forward equations 
for (ft and show they have a unique solution. 

Lemma 5.1. The Kolmogorov forwards equations for (p% are given by 

f t ^(x) = J2^ l (yMy^) + Q(yM(x)] (5.1) 

yeA 

These equations have a unique solution. 

Proof: The Kolmogorov forward equations for P t are: 

j f Pt{z,x) = ^P t (z,y) q{y,x), z e A, x E A U {0} (5.2) 

yeA 

Write 74 = XLeA f i (. z ) p t( z i 0) an d differentiate (jl.l|) to get 

d a ( s _ J2 z eAKz)ft P t(^ x ) , Hit) E z eAKz) P t&x) 
ft \ x ) ~ 1 ' 



dt I - It I ~lt 1 - It 

E^eAMj J2 y eA p t( z ^y) q(y,x) 

1-7* 

E z eA^( z )Ey<,A p t(^y) gM) Y, z eA^z)P t (z,x) 

i -n ' i -n [ ' ' 

which equals (|5.1j) . 

To show uniqueness let ip t and ipt be two solutions of (jl.l(J|) and e t (x) = \ft( x ) ~ 4>t(x)\. 
Then e t satisfies the inequation 

j t e t {y) < ^e t {z)q{z,y) + ^ \<p t {z)<p t (y) - M z )^t{v)\ Q( z , 0) (5.4) 

zGA zGA 

Bound the modulus with <p t (z)et(y) + et(z)i/)t(y) , sum ()5.4j) in y, call £7 t = J2 y eA e t(v) anc ^ 
use g(z, y) < q and g(z, 0) < C to get 

^-E t <(2q + 2C)E t (5.5) 

This implies E t < E e ^ +2C)t . Since E t > and E = 0, £ t = for all t > 0. □ 
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Proof of Theorem 11.21 We first show convergence of the means 

Km E( v ^(x)) = tf{x). (5.6) 

Sum and subtract J2 y eA ) E ( !Z ^) E ( ! n^) to HH to get 

EC C — ^ — J = 1^ N (g(y.*) + g(y.o) j (5-7) 

+ £ g(y, 0) (E(ifc^(y)^(x)) - E^(y)E^(x)) .(5.8) 
2/eA 

By Proposition 14. 1[ the family (Er] t (x) / N , n e N) is tight. Call the limit along a 
convergent subsequence. Use q(x,y) < q, q(y,0) < C and ()4.1|) to bound the summands 
in (|5.7|) and ()5.8|) by (q + C)e ct pP t (x) and Ce ct pP t (x), respectively and use dominated 
convergence to take the limits inside the sums. Proposition 13.11 implies ()5.8|) converges 
to zero as iV goes to infinity for any subsequence. We conclude that the limit along a 
convergent subsequence must satisfy 



¥C N n N ' ,J '(r) ^-^ 

iim — = J2 p"(y) to *) + 9(W, ( 5 - 9 ) 



•yeA 



If F is a bounded function twice continuously different iable and with uniformly bounded 
derivatives, then, 



F( Vt ) - F( Vo ) - [ CF{ Vs )ds (5.10) 
Jo 



is a martingale (see Kipnis and Landim (1999), for instance). We choose F(r). 



x e A. Since EMf = 0, 



AT\ _ »?t (a) 
i / N ' 



EF(ryf) = EF(t^) + E / ' £^!^Mrf s . (5.11) 



o 



iV 

From ()5.9|) we conclude that any limit p^ 1 must satisfy 



rf(x)=f$(x) + [ T i ^{y)[q(y,x) + q{y,Q)pi:(x)]dt. (5.12) 

which implies pt must satisfy (jl.lOj) . the forward equations for <pf. Since there is a unique 
solution for this equation, the limit exists and it is <p^. 

Taking y = x in ()3.20j) . the variances asymptotically vanish: 

gWigW (5 . 13) 

A^oc iV 2 
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This concludes the proof. □ 

Uniqueness and the Yaglom limit convergence of Theorem 11.41 is a consequence of the 
next Theorem. 

Theorem 5.1 (Jacka & Roberts). If there exists an x G A such that a > C and there 
exists a QSD v for Q, then v is the unique QSD for Q and the Yaglom limit hl.ty converges 
to v for any initial distribution p. 

Jacka and Roberts use the stronger hypothesis inf y£ \q(y,x) > C for some x G A 
but the proof works under the hypothesis a > C. 

Proof of Theorem 11.41 Since a > 0, the FV process governed by Q is ergodic by 
Theorem 11.31 Call 7] N a random configuration chosen with the unique invariant measure. 
Since KC N r] N (x) = 0, summing and subtracting J2 y eA liVi ®)p N ( x )p N (v)i we g e ^ 

= ^p iY (y)[g(y,x) + g(i/,0)p JV (x)] 
j/eA 

+ £»<».°>(e(^^) -K"¥X"¥)) <» 4 > 

which holds for any and x G A. By Proposition 14.21 (p , N G N) is tight and by 
()4.3|) dominated uniformly in A^ by a summable sequence. Bounding - ^ by one, the 
covariances of (|5.14j) are bounded by p N {y)- Hence we can interchange limit with integral 
in (|5.14|) and use (|3.21|) to show that the second term in (|5.14|) vanishes as A^ goes to 
infinity. Then any limit p by subsequences must satisfy the QSD equation ()1.2|) . Since by 
Theorem 15 .11 the solution is unique, the limit liniAr p N exists and equals the unique QSD v. 
□ 
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